Bayesian Occam's Razor Is a Razor of the People
نویسندگان
چکیده
منابع مشابه
Occam's Razor
The Bayesian paradigm apparently only sometimes gives rise to Occam’s Razor; at other times very large models perform well. We give simple examples of both kinds of behaviour. The two views are reconciled when measuring complexity of functions, rather than of the machinery used to implement them. We analyze the complexity of functions for some linear in the parameter models that are equivalent ...
متن کاملA Quantitative Occam's Razor
Interpreting entropy as a prior probability suggests a universal but “purely empirical” measure of “goodness of fit”. This allows statistical techniques to be used in situations where the correct theory — and not just its parameters — is still unknown. As developed illustratively for least-squares nonlinear regression, the measure proves to be a transformation of the R statistic. Unlike the lat...
متن کاملOn the Bayesian “occam Factors” Argument for Occam’s Razor
This paper discusses some of the problematic aspects of the Bayesian first-principles “proof” of Occam’s razor which involves Occam factors. Although it is true that the posterior for a model is reduced due to Occam factors if that model is capable of expressing many functions, the phenomenon need not have anything to do with Occam’s razor. This paper shows this by i) performing reductio ad abs...
متن کاملOckham's razor is not so sharp
A 39-year-old male with newly diagnosed HIV had cavitary pneumonia initially attributed to Pneumocystis jirovecii but actually caused by Rhodococcus equi. After neurological deterioration, he was found to have intracerebral lesions caused by Toxoplasma gondii. This case underscores the inability to rely on the search for a unifying diagnosis (Ockham's Razor) in HIV-infected patients.
متن کاملSharpening Occam's Razor
We provide a new representation-independent formulation of Occam’s razor theorem, based on Kolmogorov complexity. This new formulation allows us to: (i) Obtain better sample complexity than both length-based [4] and VC-based [3] versions of Occam’s razor theorem, in many applications; and (ii) Achieve a sharper reverse of Occam’s razor theorem than that of [5]. Specifically, we weaken the assum...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Cognitive Science
سال: 2017
ISSN: 0364-0213
DOI: 10.1111/cogs.12573